Add support for custom/provisioned models in Bedrock #922
Conversation
There was a problem hiding this comment.
Thanks for this addition. Will this make the drop down for all Bedrock models redundant? Do we need PR #923 ?
Tested the branch. For example:
... followed by issuing a query:
Suggested improvements:
- As can be seen in the example, you can enter the ARN or the model id. Say that in the string below the Model ID entry box?
- State the full form of ARN in parenthesis (Amazon Resource Name) and point to this page for reference: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference-arns.html
- The model provider asked for in the UI is always lower case, whereas in the model-ids table it is upper case. This may be confusing to the user, can we make this more clear if lower case is required?
- Add this feature/enhancement to the documentation?
No, it does not. We should continue to allow users to select Bedrock models by picking one from a list of options rather than force them to type out the model ID manually.
|
There was a problem hiding this comment.
Thanks @dlqqq for making the suggested changes. I have tested the new code with Model IDs but have not been able to test it with an ARN as yet (though my env/installation is updated with langchain-aws 0.1.13), which is needed. Am approving the code and documentation changes so far modulo testing for the ARN.
I have also assigned the new issue #924 to myself to expand the documentation.
|
@srdas Thank you! Note to other readers: this PR requires |
* add BedrockCustomProvider * pre-commit * format help text * show model ID field * edit BedrockCustomProvider help text * add mention of BedrockCustom in docs
Description
Adds support for custom/provisioned models on Amazon Bedrock. To do so:
Amazon Bedrock (custom/provisioned) :: *in the chat model dropdown.anthropic.claude-v2, then you should enteranthropic(all lowercase) as the provider.ai21,amazon,anthropic,cohere,meta, andmistral.Demo